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~ ABSTRACT 


A multiple frequency quaternary phased shift keyed (MFQPSK) signaling system 
has been developed and experimentally tested in a controlled environment. In order to 
insure that the quality of the received signal is such that information recovery 1s possible, 
error detection/correction (EDC) must be used. This thesis reviews various EDC coding 
schemes available and analyzes their application to the MFQPSK signal system. 
Hamming. Golay, Bose-Chaudhuri-Hocquenghem (BCH), Reed-Solomon (R-S) block 
codes as Well as convolutional codes are presented and analyzed in the context of specific 
MFQPSK system parameters. A computer program was developed in order to compute 
bit error probabilities as a function of signal-to-noise ratio. Results demonstrate that 
various EDC schemes are suitable for the MFQPSK signal structure, and that significant 


performance improvements are possible with the use of certain error correction codes. 
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I. INTRODUCTION 
A. CONCEPT OF OPERATIONS 


Modulation is the process by which signals are transformed into waveforms tailored 
to the characteristics of the transmission channel. The medium for the data transmission 
may be free space, a wire, an optical fiber or underwater acoustics, each possibly re- 
quiring a different modulation technique. It is not desireable to have to design com- 
munications links around the type of modulation dictated by the propogation medium. 
A single modulation technique that is flexible, can be used for analog and digital signals, 
is not channel restrictive, and can emulate existing modulation techniques would be 
ideal. 

Multi-Frequency Modulation (MFM) [Ref: 1] is a technique that embodies some 
of the above characteristics. Developed at the Naval Postgraduate School, MFM was 
designed for computer-to-computer communication links and information exchange 
networks. Applications of MFM to Navy satellite communication, ship-to-ship, shore 
communication and acoustic communication are being considered. MFM systems op- 
erating at audio frequencies are particularly suited to acoustic communications. Con- 
current research with Naval Ocean Systems Center (NOSC), San Diego is ongoing in 
this area. More specifically, a Multi-Frequency Quaternary Phased Shift Keyed 
(M{FQPSK) signaling svstem is being built and tested by NOSC with Naval Postgraduate 


School assistance. 


B. PREVIOUS RESEARCH 

The MFQPSK signaling system is well suited for high data rate acoustic communi- 
cations [Ref. 2]. Research in MFQPSK signaling systems at the Naval Postgraduate 
School is currently in progress. However, past efforts in this area of research have pri- 
manily focused on the generation of the signal itself through Fast Fournier Transform 
techniques. Limited attention has been given to the quality of the received signal. That 
is, error detection’correction (EDC) has plaved a minor role in signal development to 
date. During an initial feasibility studv, a single error correction/double error detection 
radix-5 Hamming code was proposed [Ref. 3]. However, since this initial proposal, EDC 
coding has been generally neglected, although it 1s seen as a necessary tool for the suc- 
cessful use of MFQPSK. 


C. OVERVIEW 

The purpose of this study is to explore various coding schemes and evaluate their 
effectiveness when used in conjunction with MFQPSK signaling. Three coding schemes 
in particular (BCH, Reed-Solomon and convolutional) are singled out and explored in 
depth. An algorithm was developed to evaluate the performance of these codes and their 
application to this project. Chapter Two describes the MFQPSK signal, so as to provide 
a brief conceptual understanding of the signal without going into the in-depth explana- 
tion that can be found in References 1 and 4. In Chapter Three, derivation of the basic 
probability equations and explanation of some of the channel variables that affect signal 
transmission are presented. Chapter Four presents a detailed discussion of various 
coding schemes and their associated bit error performance. Some schemes (such as 
Hamming and Golay codes) are presented for completeness in describing the funda- 
mentals of coding theory but are not analyzed in depth in so far as their application to 
MFQPSK signaling. Chapter Five is devoted to the application of error performance 
characteristics of various coding schemes to the MF QPSK signaling system. Chapter 6 
concludes this study by singling out a particular coding scheme that 1s well-suited for the 


MFQOPSK signaling and suggesting areas of further research. 


Il. THE MFQPSK SIGNAL 


The specific design parameters of the MFQPSK signal used in this research project 
are not necessarily design constraints on the EDC coding scheme. However, they are 
included here in order to provide the reader with a better understanding of the MFQPSK 
signal and the overall MFQPSK communication system operation. By modulating fre- 
quencies with phase information and using frequency to time domain transformations 
via the Fast Fourier Transform (FFT), the MFQPSK transmission signal can be gener- 
ated. 

Figure | shows the basic structure of the MFQPSK signal. 
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Figure 1. The Structure of the MFQPSK Signal 


Frequency is plotted on the vertical axis depicting M tones, Af Hz apart. Time is plot- 


ted on the horizontal axis showing N bauds each of length AT seconds. The symbols, 


{p,} represent the phase of the jy" tone in the / baud. In quadrature phase 
(2 bits’symbol), {¢@,} =4 + — an 

In the MFQPSK signaling system, the {¢,} components represent unique 
time'frequency phases. These components and their complex conjugate at the image 
frequencies are loaded into a two dimensional array that is used as an input to an In- 
verse Fast Fourier Transform (IFFT). The image frequency components are needed to 
insure that the corresponding time domain signal is entirely real. Thus, the IFFT gen- 
erates a collection of real, time domain signal sequences that are time samples of the 
analog transmit signal. Processing these through a D/A converter completes the gener- 
ation of the ** baud. The total signal packet is completed by an N-fold repetition of this 
frequency-to-time domain transformation. 

A complete data packet, P, is made up of Jf tones in N bauds. (It 1s not necessary 
that all of the frequency bins contain data information. The j* tone could be used for 
synchronization for example.) Since one of four phases is determined by a di-bit (a se- 
quence of two binary bits) there will be 2.VA/ bits in each packet. The tone spacing 1s 
the inverse of the baud length. Bv increasing baud lengths, more tones are used and 
vice-versa. 

Demodulation of the MFQPSK signal is accomplished by a process that is just the 
opposite of the method of generation. The time domain signal is filtered, sampled and 
converted to a digital format through an A,D converter. This sequence is partitioned 
into ._V sequences corresponding to the V bauds and loaded into a complex valued array 
with imaginary parts set to zero. This array becomes the input to an FFT which gen- 
erates a complex valued array containing the phases of the original transmitted baud. 
Computing this .\-fold times, will generate the total transmitted data packet. 

This brief explanation is provided for conceptual purposes only and intentionally 
does not address the problems of synchronization, channel noise, multipath propagation 
and non-linear characteristics of the supporting equipment. Individually, these are sub- 
jects of various research projects currently associated with the MFQPSK signaling sys- 


Lei 


Il. CHANNEL/CODING CONSIDERATIONS 


A. CHANNEL CONSIDERATIONS 

The acoustic properties of the ocean constrain the MFQPSK signal in this applica- 
tion in various ways. For instance, since short signal wavelengths are absorbed more 
readily than longer wavelengths, the signal transmission bandwidth is limited by the de- 
sired maximum range of communications. This will, in turn, constrain the maximum 
rate at which data can be transmitted. Another channel consideration concerns the 
multipath characteristics of acoustic propagation. Surface and sea bottom reflections 
as well as sound channels may cause the signal to propagate through various paths with 
different delavs. Doppler shift due to the movement of the source and the random dy- 
namics of the sound velocity pose additional problems. 

Acoustic channel modeling for the MFQPSK signaling system is a separate project 
being explored at the Naval Postgraduate School. Its purpose is to identify and model 
imiportant the variables of acoustic signal transmission. Also included in the model are 
the symbol energv-to-noise spectral density ratio £,/V,, the bandwidth and data rate. 
(Since E,/N, is actually a signal-to-noise ratio it will be referred to simply as SNR 
throughout this work.) Once complete, coding gains can be computed based on this 


model as a function of SNR, baud length, doppler mismatch, etc. 


B. CODING CONSIDERATIONS 

In this signaling system, the purpose is to transmit digital information at the maxi- 
mum possible rate with a fixed signal power while maintaining adequate error perform- 
ance. Varying definitions of adequate error performance has led to the specification of 
manv EDC coding schemes, each exploiting some feature of the transmutter-channel- 
receiver trilogy. If the medium introduces high-level constant noise, increasing trans- 
mitted power may be the only means to compensate for the noise and ensure adequate 
receiver performance. Perhaps full replication of the transmitted signal is not needed 
on the receiving end. In this case, a lower transmitter power may be used and the 
transmitted signal extrapolated from what 1s received. Additional signal degradation 
from such variables as mulitpath propagation, fading, and doppler shift further reduce 
the received SNR and/or create decoding errors and arnplifv the need for error detection 


and correction. 


The MFQPSK signal is to be encoded from a binary data stream. Figure 2 shows 
the block structure of a binary data stream, how it 1s partitioned into information and 
parity bits and illustrates the meaning of a di-bit. 


info bits parity bits 
CooL 
di-bit 


Figure 2. Block Coding of a Binary Data Stream 


Due to the randomness of phase assignments, it may be assumed that any incorrect de- 
cisions of the receiver will have equal probabilities. 

In light of the channel considerations previously discussed, a coding scheme must 
be identified which will provide adequate error performance. However, since all these 
studies are not yet complete, all performance graphs in this thesis will be plotted showing 
probability of error as a function of SNR. 

1. Probability Development 

In this study, two error probabilities will be continually compared. The first 
will be that of a MFQPSK signal which is not EDC coded. In this case, bit error 
probabilities will be dependent on the type of demodulation used. Secondly, EDC coded 
received signal error performance for particular coding schemes will be developed and 
compared to each other in order to evaluate which coding schemes may be most suitable 
for an MFQPSK signaling svstem. 

a. Uncoded transmission 
In determining the probability of error for an uncoded bit stream, the pri- 
mary consideration is the modulation type. Since there is no coding involved, this will 
specify the performance of the signaling system. Figure 3 illustrates a QPSK signaling 
constellation developed from Reference 5. 
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Figure 3. QPSK Signal Constellation Diagram 


Receiving two bits of information, left bit and nght bit (L, and R,, respec- 
tively), the probability that the left bit was received correctly (L,C) in additive white 


Gaussian noise given that signal s, was transmitted 1s: 





Pr{L,Cls} = Pr{L,Cls}} = 1- of z (3.1) 


= Pr{L,C} (3.1a) 


The function Q(x) is the complementary error function or co-error function and is de- 
fined as: 


0 2 
Q(x) = ry | exp( = aE Jat (3.2) 


Equation (3.1a) now represents the unconditional probability that L, is correct. This is 
irrespective of what signal was transmitted. Similarly, the unconditional probability that 


R, is correct is identical. Thus, 


5 
Pr{bit correct} = 1— of | (3.3) 
0 
Therefore, the bit error probability is 


E 
p = Pr{bit incorrect} = 1 — Pr{bit correct} = of =) (3.4) 
6] 


A graph of p as a function of E,/N,, denoted SNR, is shown in Figure 4. 
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Figure 4. Bit Error Probability for Uncoded QPSK Signals 


b. Received EDC coded transmission 
When a bit stream is transmitted over a noisy channel, errors will occur 
causing the transmitted and received bit streams to differ. Given that a specific bit was 
transmitted, the probability that it is received in error is p, and the probability that it is 
correctly received is (1 - p). Given a message consisting of a string of 7 bits, the proba- 
bility of no error in all 7 bits is the individual correct probabilities raised to the number 


of n bits, namely, 
(lop (3.5) 
and the probability of a single error in the vn bits is: 
np(1 — p)" (3.6) 
Similarly, the probability of exactly two errors in the v bits is: 


Ae =) (3.7) 


Equations (3.6) and (3.7) represent exact values for probability of error. This is for the 
case that exactly » or fewer errors are detected and corrected. Codes that do this are 
called perfect codes. As will be explained in Chapter 4, there are very few perfect codes: 
the Hamming (¢ = 1), the Golay (¢ = 3) and a ternary Golay code are examples. Other 
f-error correcting codes can correct all occurrences of ¢ errors and varving percentages 
of more than ¢ errors. When computing P, for non-perfect codes, it 1s understood that 
the code is capable of correcting all occurrances of j <7 errors. However, more that f 
errors can occur, that is j=7+ 1, resulting in decoded errors. Therefore, by summing 
the total probability of j errors in the #7 positions and dividing by the number of bits leads 


an upper bound on P,, the probability of bit error of t-error correcting codes: 


Pas DJ ( 4 p (l—p)* (3.8) 


j=it+l 


where p = OL/SNR ). A plot of equation (3.9) appears as Figure 5. 
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Figure 5. General Bit Error Probability for Coded Signals 
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IV. ERROR DETECTION/CORRECTION CODES 
A. FUNDAMENTAL CONCEPTS 


Error detection’correction (EDC) coding provides error control in digital informa- 
tion transmission. An encoder adds redundancy to a transmitted message in such a 
manner that, upon decoding, the correct digital information, even in the presence of 
channel-induced errors, can be determined. Redundancy is added in such a way that the 
decoder decisions can be based on several received bits rather than on one, as in uncoded 
systems. 

Error control can be accomplished using forward error correction (FEC), automatic 
repeat request (ARQ), or a variety of hybrid FEC-ARQ approaches. Using FEC, the 
decoder corrects as many channel errors as possible. This is done by generating an es- 
timate of the transmitted sequence within the limitations of the code. Using ARQ, the 
decoder detects errors and prompts the transmitter to retransmit as required. Because 
of the duplex nature of the ARQ procedure, it was not considered viable for this project. 
Therfore FEC coding only is being considered here. 

FEC codes can be classified in two general categories, block and convolutional. 

1. Block Codes 

Block codes process data in blocks that are independent from each other. The 
encoder transforms a block of k message bits into a block of » binarv coded bits, where 
ie weeeene ratio of K/n is called the code rate R, where 0 < R < 1. Block codes are 
expressed in terms of m and A such as a(n, k) code. A block code represents a one-to-one 
transformation Where 2’ information k-tuples are uniquely mapped into a set of 2’ 
codeword v-tuples. 

A wide variety of linear block codes exist. The ones that will be considered here 
as they may apply to this project include: the Hamming, Golay, Bose-Chaudhuri- 
Hocquenghem (BCH), and Reed-Solomon (R-S) codes. 

2. Convolutional Codes. 

Convolutional codes provide output coded bits for each group of k input bits. 
However anv n-coded bit convolutional encoder output depends not onlv on the last set 
of k input bits but also on several preceeding sets of input bits. Convolutional encoders 
are described by n, k and K. The code rate, R, is defined by A/m , and K, known as the 


constraint length, is the number of stages in the shift register used. Shift registers are 


used to process the bit stream. As a bit 1s fed into the shift register, that particular block 
of bits in the shift register are modulo-2 added in a predetermined manner, described by 
so-called generating polynomials, and the encoded bit stream output is taken from the 
modulo-2 adders. The next bit is then fed into the shift register causing all previous bits 
to shift one stage and the output is again taken from the modulo-2 adders. This process 
is repeated until all the information bits are processed through the shift register. 
Convolutional codes are expressed either as (n, k, K) or (R, AK). As an example, a 
(1/2, 3) convolutional encoder is shown in Figure 6. 
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1) code symbol 
Input bit__ Output 
m branch word 
Second 
u 
: code symbol 


Figure 6. Convolutional Encoder: (Rate = 1/2, K = 3, reproduced from page 
319 of Reference [6]) 


B. HAMMING CODES 

Hamming codes are a class of block codes used for error detection and/or correction 
applications. They are also members of a group of codes called perfect codes. A perfect 
code is one in which all the vectors described by the code are contained within a sphere 
of radius = [(d,,, —1)/2] about the codewords. Here s represents the number of errors 
the code can correct and d,,, is the minimum distance between codewords of the code. 
Minimum distance is an integral part of determining the error correcting capability of 


block codes. To define d,,,,, consider the following: 1f u and v are two vectors of a code 


]2 


Cad 


then, by definition, u@ v must also be a code vector where code vectors represent a bit 
sequence of length m and © indicates modulo-2 addition. The Hamming distance be- 
tween any two code vectors 1s equal to the number of places where the two code vectors 
disagree. This corresponds to the weight (i.e., number of 1’s) of u@v. Thuis d,,, is the 
minimum weight of all non-zero code vectors. A Hamming code has (n = 27-1, k = 
2” -l-m, d,,,= 3). Therefore, one can see the (7, 4) Hamming code has a minimum 
weight of d.;,, = 3 and therefore, has a single error correcting capability. The binary 
Hamming (7, 4) code 1s also perfect since 2? (the number of vectors in a sphere of radius 
1 about a codeword) times 24 (number of codewords) equals 2’, the total number of 
vectors (Ref. 7]. 


Hamming codes are developed around some basic principles: 


All noise 1s modeled as channel noise. 
e The channel 1s a binary symmetric channel. 


¢ In all computations, modulo base must equal radix base (in most cases this will be 
modulo 2). 


¢ Hard decision decoding is used.! 


Parity check matrix and svndrome development are necessary when evaluating block 
codes. The parity check matnx H consists of all nonzero m-tuples as its columns, ar- 


ranged in the following form: 
H=[I Q] (4.1) 


Where I is an m x » identity matrix and the submatrix Q consists of 2”-m-1 columns 


which are m-tuples of weight 2 or more. As an example, with m = 3, 


OnOuOs tala 
H={0101011 (4.2) 
0) a eel 


The coded vector c of a Hamming code is constructed from binary representations 
of position locations. All odd numbered positions end with a 1 when represented 1n bi- 
name oume | hererore, a parity check 1s used to cover the odd positions 1, 3,5, /, .... 


Similarly, the second parity check covers positions 2, 3, 6, 7, 10, 11 all these positions 


1 Hard decisions refer to the cases in which no confidence associated with the bit decision is 
known. 


have a | in the second-lowest position in its binary form. The third parity check will 
cover positions 4.9607 7, 12 elena see 

If the information to be transmitted contains four bits, say [1 0 1 0], the coded vector 
will be constructed as [- - 1 - 0 1 O] where the (-) are used as parity checks. The total 
number of odd positions 1’s are modulo-2 added and the result entered in the first posi- 
tion. Nowc = [1-1-0100]. Next, the second parity check is entered in position two 
as the modulo-2 sum of the digits in positions 2, 3, 6, and 7. The coded vector is now 
[101-01 0]. Finally, by modulo-2 adding the 1’s in positions 4, 5, 6, and 7 the third 
parity check is accomplished and c 1s completed as {101101 O]. 

Given a coded transmitted vector c, where c 1s the coded bit stream of information 
bits and error correction coding, and a received vector r, Reference [8] defines the syn- 
drome as S=rH. The syndrome will be used to locate error positions. If no trans- 
mission errors occur then, since Hc’ = 0, Hr’ = 0 because —c- 

To continue the above example, letc=r = [1011010]. This is the desired 


coded transmission and contains no errors. Therefore, the syndrome 


S =Hr’ =0 
l 
0 
PL 0 a as Ps 
S— 10s e Oe Ose || eo (4.3) 
0011101440 
l 
0 


Ifa single error were introduced, the received vector would be: r = (c +e) where ¢ re- 
presents the transmitted vector and e represents an introduced error. Computing the S 
vector, S = Hc’? + He’ and knowing that He’ = 0 , S=He’. The syndrome depends on 
the error vector and not on the codeword sent. The syndrome is a vector which repres- 
ents the column where the errors occur. 


Now using the previous example, let the transmitted vector be 


¢ = [1011010] (4.4) 


and lete = [0001000], sothatr=[1010010]. 
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Since 


Eeceee 36 
and 
Hc’ = 0, 
then, 
] 
0 
aor oor | l 0 
Se Oe Olea) | OQ} = if (4.5) 
O20 le O11 0 | 
] 
0 


Comparing the svndrome to the H matrix shows that entries in the fourth column 
of H are identical to the syndrome thus indicating an error in the fourth position of the 
received vector. By inverting the digit in this position, a correction to the received vector 
1s accomplished. 

Hamming codes can easilv be extended to double error detection single error cor- 
rection codes by adding a parity check as the top row of the matrix. For example, the 


H matrix of Equation (4.2) results in 


EL, lle vied 
10001110 

sie (4.6) 
Onl On ie Oot 1 6 


USO aieo lO. 10 


The usefulness of this extension 1s limited as the extended Hamming code can only detect 
the existence of a double error, and still only correct single errors. 

Hamming codes were developed for self-checking of the Model 5 Relay Computers 
built by Bell Telephone Laboratories in the late 1940's [Ref. 8]. Because of computer 


infancy at the time of the code’s creation, Hamming codes are relatively simple and of 
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limited capabilities by today’s standards. However, they serve as the cornerstone of 
EDC coding and are described in this report for completeness. 

The initial feasibility study of the MFQPSK signal included a radix-5 Hamming code 
for each of the frequency bins [Ref. 3]. Using modulo-5 algebra and a two-dimensional 
matrix, the radix-5 code proved useful. However, as with all Hamming codes, it was 


only capable of single error correction. 


C. GOLAY CODES 

The next extension of the Hamming code is the Golay code. Like the Hamming 
code, the (23, 12) Golay code is also a perfect code. In fact, the Hamming and Golay 
codes are the only known binary perfect codes.2 Because the code rate (k/m = 12/23), 1s 
awkard to work with, a parity bit 1s added creating an extended (24, 12) Golay code. 


This added parity bit increases d,,,, from 7 to 8. Both Golay codes possess triple error 


in 
correcting capabilities. The extended Golay code 1s more powerful than the Hamming 
codes but also carries drawbacks: a more complicated decoder, a lower code rate and, 
with it, greater bandwidth expansion. 

Although Golay codes’ error performances are superior to Hamming codes, from a 
practical point of view, Golay codes are limited by their short block lengths and have 
limited practical application when considering the availability of other more powerful 
codes. The Golav code’s uniqueness as a perfect code (or quasi-perfect for the extended 
Golay code) carries with 1t many mathematical properties which are used in coding the- 


ory to group theory and other, more esoteric, mathematical topics. 


D. BCH CODES 

Of the many classes and subclasses of random error-correcting codes proposed to 
date, the class discovered by Hocquengheim in 1959 and independently by Bose and 
Chaudhuri in 1960 1s the most extensive and powerful one. The Bose-Chaudhuni- 
Hocquenghem (BCH) codes are a generalization of the Hamming codes but allow 
multiple-error correction, while providing a large selection of block lengths, code rates, 
and error correcting capability. Because of this flexibility, there are many BCH code 
implementation algorithms. At block lengths of a few hundred, the BCH codes outper- 
form many other block codes with similar block length and code rate [{Ref. 6]. 

For any positive integer m and ¢ (¢ < 27-'), there exists a BCH code with the fol- 


lowing parameters: 


2 There is a perfect ternary (11, 6) Golay code but it will not be discussed in this research. 


Block length: n= 27-1] 
Number of paritv-check digits: n-k<omt 
Minimum distance: dain 2 ot + 1 

This code is capable of correcting any combination of ¢ or fewer errors in a block 
ofnm = 2” -1 digits. 

The alphabet of a BCH code for n = (27-1) may be represented by the elements 
of the appropriate Galois Field, GF(27), whose primitive element is a. The generator 
polynomial, g(+) of the t-correcting BCH code is given by the least common multiple 
GEG) ofere( ) afs(X), ..0.6,(X). That is, 


9(.X) = LCM[LM,(X), MQ(%), «O10 ] (4.7) 


where :/(.1) is the minimum polynomial of of «@, 1 = I, 2, ..., 27, each unique to 
GF(2”) .3 Since the minimum polynomials for «?, a’, ..., «7 (all even powers of @ ) are the 


same as those of a, a, @3,..., the generator polynomial is reduced to: 
9(A) = LGW CX) e(X), ef, (49) (4.8) 


Values for \/(.X) are tabulated in texts and technical reports based on values of m for 
specific GF(2”). 
Consider a (15, 7) double-error correcting BCH binary code for which m = 4. The 


generating polynomial 1s: 
o(X) = LOM ERI, (4), VGC] (4.9) 
— VHOe ae’ 
= (1 ee eee ee) 
See eX ee (4.9a) 


Similarly, for a (15, 5) triple-error correcting BCH binary code over GF(2‘), the gener- 


ating polynomial 1s: 
9(X) = LCM[AL (4X), M,(X), M5(49]J (4.10) 


3 The minimum polynomial over GF(2”) of B is the lowest degree monic polynomial .\/(f) 
with coefficients from G/(2”) such that Af(p) = 0. 


rE? 


=(1¢ XX )14 X42 0 oe ee eee) 
ee Oy ee Ge as aE (4.10a) 


1. Use of Generator Polynomials 
Generator polynomials are used in the formulation of a generator matrix, G, 
where G = [I, P] and a parity check matrix H, where H = [I,_, P’7]. A code vector 


¢c, 1s obtained by multiplving the message vector m and the generator matrix G, namely 
c=mG (4.11) 
The yeceived vector m villiconsistici, 
=c+e (4.12) 
(If there are no errors, e = 0.) Obtain the syndrome S, 
S =rH’ =eH’? (4.13) 


Then bv inverting the digits at the locations specified by the syndrome, the decoded 
vector d is obtained, where d corresponds to ¢ so long as there are ¢ or fewer errors. 
2. Decoding BCH Codes 
Chapter 6 of Reference [9] presents a detailed discussion of decoding BCH 
codes. The highlights of that discussion are presented here. Consider a received vector 
r = c(X) + e(X) as before. Since g(X) is a factor in c(X) and «, a, ..., « are the roots 
of g(X) then, 


r(cc') = e(a') + e(c’) (4.14) 
=e(o') i=1,2,...22 (4.14a) 
since c(a’) =0. Define now the syndrome vector 
S, = r(a’) (4.15) 
=Ty +10 + 15(0 ee, (0) nel (4.15a) 


where 7), /,, ...; mepane tle COciHicients Of Tawa. hus: 


S, = e(o) (4.16) 
=, 48 Gor SEO p eon (4.16a) 


In order to simplyfv the notation, assume p errors have occurred where 0 < p< 1 at lo- 
cations given by X,, X;,..., X, and magnitudes (binary digits) given by Yj, ¥,..., Y,. Then 


the syndrome vectors may be written: 


5704 SiG eae 


S.= YX} + YX} +..+ ¥,X 


>, ae (4.17) 


$7 Sey as te 


The difficulty in solving this set of equations is due to their non-linearity and non-unique 
solution. By defining intermediate variables and an error locator polvnonual, /(z) given 


by 

ja) =r rca 12 + | (4.18) 
wimelnas Zeros at the inverse error locations 1,', |= 1, 2, ..., p. Then, 

AZ) ea) 235). (lz k.,) (4.19) 


The zeros of this equation lead to the error locations and are equal to the coefficients, 


Ayy 45-1» ++) 4, OF A(z). The coefficients and syndromes are related by the matrix equation: 
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Sy  S3 S4 Sp42 } p-l Spo 
S3 S4 Ss : S743 } p—2 —S543 

M a a ° e e e e = e (4.20) 
OS: Soa Sy? e Sop—1 , oF 


Provided that this matrix is nonsingular, and therefore invertible, the above equation can 
be solved. Proof of nonsingularity is found on page 169 in Reference 10. 
Consider for example a (15, 7) double error cormecting BGM code in GFZ rane 


modulo polynomial given by 14+ 4+ 1, so that 
o(X) = eee ere re eal (4.21) 
If the message, m(X) = (1 + X), then the transmitted vector is 
(X) Sey a eee era: (4.22) 
The received vector 1s now assumed to be 
YS Xo ee eel (4.23) 
so that 
eax + X (4.24) 


Computing the syndromes according to Equation (4.17), 


S,= oto =a) (4.25a) 
S,=0° + 0° =a'! (4.25) 
S,=a" +0’ =0 (4.25c) 
S,=0 +07 =o’ (4.25d) 


SS 


#(). Therefore, 





The determinant, det M = 
2 3 
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13 11 
OX ax 
w]e | (4.26) 
aX 


0 
therefore, 
= O a 
Wi Nag (4.27) 
a oO 
and, 
}» 194 53 
= vi 4.28 
)-00/ 8 4.29) 
b aan 
a ee z 
“a oO 0. 
1] 
os 
oF 
as: 
aA oz? + al*2 +] (4.29) 
=(o°2 + L)(o?z a2 (4.29a) 


The error locations occur in the 3rd and 8th positions giving e(X) = 47+ 4°. By in- 
verting the digits in these positions of the received vector, error correction is accom- 
plished. 

Various numerical methods, e.g., Chien search, Berlekamp’s iterative scheme, 
and the Peterson-Gorenstein-Zierler algorithm, have been developed to assist in solving 
the error locator polynomial of the BCH codes. Their development and descriptive use 
may be found in References 9, 10 , and 11. 

3. Performance Evaluation 

Error performance of BCH codes are based on maximum likelihood decoding 
principles. Since the weight structure is known only for a small fraction of the family 
of BCH codes, most decoding algorithms are based on having no knowledge of the code 


weight structure. This leads to the probability relationship expressed in Equation (3.9). 


An upper bound to the decoded bit error probability can be found from 
Equation (3.8) as modified for BCH coding: 


Pas » (4) eu =P) (4.30) 


j=t+1 


Since the values for ¢, n and k are known for all values up tom = 1023, Equation 
(4.30) can be evaluated as a function of p. For the case of BCH codes, the co-error 


function is modified to account for code rate, R: 


E. ; 
p= o( 2k = (4.31) 
oO 


Figure 7 illustrates the upper bound of various BCH codes as derived from 
Equations (4.30) and (4.31). 
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Figure 7. Performance of Various BCH Codes 


It has been shown in Reference 12 that between code rates of 1/3 < R < 3/4, a broad 
maximum of coding gain versus code rate for fixed values of n occur. Performance de- 
grades significantly for particularly high or low code rates. Figure 7 illustrates per- 
formance of the BCH codes with R=1/2. 


FE. REED-SOLOMON CODES 

A very important subclass of nonbinary BCH codes are the Reed-Solomon (R-S) 
codes which achieve the largest possible minimum distance (d,,,) for any linear block 
code with specified block lengths. For nonbinary codes, the distance between code 
words is defined as the number of nonbinary symbols by which the two code words dif- 


fer. The minimum distance for these codes are given by: 


agli Ket (4.32) 
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but since n-k = 2r1, 
da = pai = ] (4.33) 


R-S codes use a non-binary alphabet of 2” symbols represented by GF(2”). How- 
ever, for R-S coding with m = 1, g = 2”, the symbol field GF(q) and the error locator 
field GF(g”) are the same (as such, R-S codes are examples of a g-ary BCH codes). For 


m = 1, the g-arv BCH code becomes a r-error correcting R-S code with the following 


parameters: 
Block length: n=q-1 
Number of parity digits: n-k = 2t 
Minimum distance: d=2t+ 1 


1. Generator Polynomial 
Using a R-S code with code symbols from the alphabet established by GF(q) 


Where g = 2”, the generator polynomial of a t-error correcting code of length 27 — 1 is: 
of X) = (Xt aX + 0°)..(Y + 074 (4.34) 


where @ is a primitve element of GF(g). This is always a polynomial of degree 2: and 
satisfies the  - kA = 22 constraint. 
As for BCH codes, the R-S code vector 1s obtained by multiplying the generator 


matrix and the message vector to produce: 


c=mG (4.35) 
Let 
(Xx) =c, +c, X ek - oe (4.36) 
be the transmitted vector and 
r(X) =r +r ,X + rX* +..+ r, (4.37) 


be the received vector. Then the channel error, e(X), is the difference between the 


transmitted and received vectors and is a symbol from GF(q), 
e=€)--€)4 + e,X” +... oe (4.38) 


or equivalently, 
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e(.X) = r(X) — c(X) (4.39) 


If e(X) represents an error pattern of less than or equal to ¢ errors, at positions 
XA, X72, X7, then 


e(X) =e, K +e XP +. + eX. (4.40) 


In order to determine the error vector, the error locations, j,, and the error values, ei, 


must be found. Defining 
B= ol for 1=1,2,.., 9 (4.41) 


as the error locations, the value of the error at the location corresponding to f, is given 


by the following equation [Ref. 9]: 


= 
=< i 


[| +867) 


i=] 
where 
AGG = 1 ES, ee VES oe, S. Haase 
+ (Sy +6,S,_) + 6)8,_) +0. Fy) (4.43) 


wleers .)....5, are the svndrome components S, s. 
2. Decoding of R-S Codes 
In order to decode the R-S code, the procedure is the same as that for any qg-arv 
BCH code with the addition of a final step. Final calculation of the error values using 
Equation (4.42) is necessary. The best way to demonstrate R-S decoding is with an ex- 
ample (Ref. 9]. 
Consider a R-S code with symbols from GF(2*) and ¢ = 3. The generator 


polynomial 1s: 
o(X) =(X + aN + oN t oF VX + VK + (XK + @°) (4.44) 


See ee eee tooo N+ (4.44 a) 


Z 


Assume that the all-zero vector was transmitted and r, the received vector is given by r 


= (000a70003000000,400). As such, r(X) = a7X3 + oF XS + AX, 


nents are generated using Equation (4.17): 


S =ra)=a +a? tasa” 


S, =r’) =a? +] 
S,=ro)=ata°+o'° =e 
S,=r(o)=a toa? ta’ =o!" 
Ss=ro)=a' +a°+a°=0 


S,=r(o°) =o +0? t+a=0" 


The syndrome compo- 


(4.45a) 
(4.455) 
(4.45c) 


(4.45) 


(4.45e) 


(4.45f) 


Using an iterative algorithm developed by Berlekamp, the error location polynomial 


o(.X) must be found. The description of this algorithm is a lengthy process which mav 


be found in References 9 and 13. The following is offered without proof. The error lo- 


cation polynomial o(\) = 14+ 0°X 4+ otk? + 0642. By substituting |, a, o7,..., o'* in o(4), 


the roots of o (XN) are: a*, a? and @'. These are the error locavionmilinbers of the Crem 


pattern e(X) and the errors occur at positions X°, 1% and X”. 


Now the error values, e,, must be computed according to Equation (4.42): 


ze ks 
5 gee —6 6 -9 
IlIt+o0 +o +a¢4 


a (1 + oo) + a }*y73) 


_ bal gaome oe eae 


6 = = 
(hee Vl +o oes) 
ee oe ee re 5 
Te an — prea iL 
9 9 
a a 
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(1 + of 0 a + oa |?) 


(4.46) 


(4.47) 


(4.48) 


pp sete alliga 
ig 5 ot ahaa 
or oF 
Thus the final error pattern is: 
e(X) = aX? + a X° + aX (4.49) 


This corresponds to r(-X) — c(X) so that the final decoded message is found by forming 
r(X) — e(X) and the transmitted all-zero vector is therefore recovered. 
3. Performance Evaluation and Application 
The greatest advantage of the R-S codes is that they achieve the largest possible 


code minimum distance, d,,,,. This distance is given by: 
dan =N—-k+1 (4.50) 


Therefore, R-S coding can correct up to ¢ errors as follows: 





po = 511) 


and therefore onlv requires 2¢ paritv bits. 

In binary (x, k) coding, the entire 7-tuple space is comprised of 2” binary words. 
Similarly, the k-tuple space is made up of 2‘ binary words. Since R-S codes are nonbi- 
nary, the n-tuple space 1s expanded to mm-tuple where :m is the number of bits used to 
represent each svmbol. This expands the codeword space to 2”", a number significantly 
larger than 2’. This also makes the Am-tuple space larger but the ratio of k/m decreases. 
The result is that when small fractions of n-tuple space are used for codewords, a code 


muthlarce a. is created. 


The decoded bit error probability associated with a R-S code follows from the 
results shown in Equation (3.8), with a shght modification. The upper bound to P, 1s 


given by 





Pps y cal) (") far? (4.52) 


j=itl 





where the scaling factor accounts for the average number of information bits per 


|| 
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symbol error. 
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F. CONVOLUTIONAL CODES 

Previous sections have presented various block codes where the data is grouped in 
A-bit words and coded into n-bit words where n/k represents the redundancy necessary 
for error detection and correction. Contrasting this technique are convolutional codes 
where the encoder accepts data in groups of k symbols and provides an encoded output 
in groups of m symbols, where » > k. However the encoder output not only depends 
on the current input data but also on previous data blocks; that is, the encoder has 
memory. Convolutional coding is affected by constraint length (number of stages in the 
shift register) and code rate, R = &k/n. Significant coding gains and the availibility of 
decoding algorithms which can take advantage of soft receiver decisions, and the relative 
ease With which both the encoder and decoder can be implemented have lead to wide- 
spread use of convolutional codes. 

The most commonly used convolutional codes utilize & = 1. In this case, infor- 
mation bits are shifted into the encoder one bit at a time. As the 7” bit is applied to the 
input of the shift register, all previous bits are sequentially shifted one stage to the right 
and modulo-2 summed as prescribed by the generating polynomial. The output is then 
transmitted while the 7" + I bit 1s applied to the shift register input and the procedure 
repeated. 

Examination of convolutional coding involves characterization of the encoder and 
decoder. The encoder can be described by one of three approaches, namelv: 1) the 
polynomial matrix approach, 2) the scalar matrix approach, and 3) the shift register ap- 
proach. In this discussion, the later will be used. Likewise, decoder characterization can 
also be described through one of three approaches: |) state-diagram approach, 2) tree 
approach, and 3) trellis approach. 

1. Shift Register Approach 

A (1/2,3) convolutional encoder with generator polynominals (\?+ + 1) and 
(A? +1) shown in Figure 6, will be used as an example. Selection of generator 
polynomials is purely arbitrary and is limited only by the number of stages in the shift 
register. Let the message vector m = (1 0 1), the shift register initially loaded with all 
zeros and the output branch word formed as u, u,. 

The initial message input generates an output of I 1 from the modulo-2 adders. 
As the next message bit is applied, the initial bit is shifted one stage to the right and the 
output 1s now | 0. This procedure continues until the message vector has passed 
through the shift register and (K - 1) zeros are input in order to flush the register to its 


initial all zero state. In this example the ouput sequence is: 11 10 00 10 11. 


Any number of shift registers and modulo-2 adders may be used depending on 
the complexity desired. Generating polynomials will determine the number and location 
of modulo-2 adders. 


2. Trellis Decoding Approach 


The trellis diagram for the (1/2, 3) convolutional encoder is shown in Figure 8. 





Figure 8. Encoder Trellis Diagram: (Rate 1/2, K = 3) 


In order to decode using a trellis diagram, the trellis encoder must first be generated. 
It is formed as follows: from any time state, 4, where /= 1, 2,...,2X, there are one of two 
transiuons that may occur; these represent either a | or 0 being applied to the shift reg- 
ister input. By mapping the result of each ume period to the next time period, ¢,,, the 
trellis can be completed. The symbols on each of the branches of the trellis are the 
modulo-2 added output as a result of transitions from one time period to the next. For 
instance, referring to Figure 8, at ¢ = 3 in the | O state an input of 0 will result in a 
transition to the 0 | state at 4, along the branch labeled 1 0. The output as a result of 
this transition would be the same as the branch label, 1 0. An input of 1 will result in 
transition to the | | state at ¢, along the branch labeled 0 I. A completed encode trellis 
diagram represents all possible state-time transitions and is fundamental to trellis de- 


coding. 
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The decoding algorithms of trellis codes can be lengthy and complicated proc- 
esses. As such, these will not be explained in this work. References 13 and 14 are re- 
commended for detailed discussions of trellis decoding. The primary objective of trellis 
decoding is to find the singular path through all time states with the least path metric. 
Evaluating the necessary steps to get from 1, to #,,, along the least path metric will result 
in the recovery of the transmitted message with the fewest, possibly zero errors. 

Viterbi’s convolutional decoding algorithm [Ref. 15] made use of trellis decoding 
combined with maximum likelihood decisions. This allows the option of soft-decision 
decoding,4 resulting in recovered message with a lower probability of error. 

3. Performance Evaluation 

Performance evaluation for convolutionally encoded data is not as straightfor- 
ward a procedure as with both BCH and R-S coding. As stated earlier, there are three 
approaches one may take when describing convolutional coding. In describing per- 
formance evaluation, most approaches use a combination of all three descriptive meth- 
ods. In this work, only one approach was used in detailing convolutional codes. 
Therefore, some terms, associated with the other two approaches, must be defined in 
order to continue the derivation of performance equations. Most terms will be intro- 
duced with a nunimum of discussion. Reference 15 provides the necessary detailed der- 
ivations. 

The first term that must be defined is the minimum free distance, d,,,. This is 
the weight of the minimum-weight path which begins and ends in the Zero state (weight 
corresponds to the number of 1’s in a sequence of binary bits). Its usual derivation 
comes from the state-diagram approach but an analogy to the trellis approach mav be 


made. In this respect, d,,, 1s the minimum path weight a code may have when diverging 


ree 


and remerging to the all-zero path. With this definition in hand, the first event error 


probability may be expressed: 


OOD 


1G » NgP 4 (4.53) 
A= ¢¢ 


where #, 1s the number of codewords with weight d and P, is event error probability of 


weight d@. A probability of bit error may be obtained from this by weighting each term 


4 Soft decision decoding allows for confidence levels when making bit decisions. These levels 
are quantization levels in the demodulator and result in more accurate decisions at the cost of 
demodulator and decoding complexity. 
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by the information Weight for each path (i.e., the number of bit errors). However, with 
a code rate of R = kj/n, there are k symbols decoded on each branch. So now P, is 
bounded by: 


oo 


l 
7 > waPs (4.54) 


T= ree 


Pp 


lA 


where w, is the total number of non-zero information bits on all d weight paths. 


Now, using the matrix approach, it can be shown from Reference 14 that: 


CN) 
a ON 





Net, Der/pI=p) (4.55) 


Peue yy — OC! EINo) and 
D = redundancy of the code 
N = unicity distance (branch traversed caused by an input of 1) 
T = generating function of a code. 


From 


oO oo 


TiDes)= > dyngd en? (4.56) 
d=Ap,¢¢ b=) 
it follows: 
6T(D, N) a y 
5 = >» di bnar (4.57) 
d=, ¢¢ b=] 
=) Bg (4.57) 
A= roe 
where 
By=) bng (4.58) 
b=1 
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Now 


Pas yeaa (4.59) 


for a convolutional code with a generating function T(D, N). 


For small values of p, Equation (4.59) 1s dominated by the first term, so that: 


Pax - By, [2/p0 — p) | (4.60) 


] Ghee 


wo By, 20 pr (4.602) 


This approximation will be used to evaluate the performance of convolutionally encoded 


data for various codes, and contrasted with the performance of block encoded data. 


V. CODING FOR THE MFQPSK SIGNAL 


When measuring the benefits of one particular coding scheme versus another, a 
common reference must be established. All other variables being equal, the coding gain 
provided by each coding scheme will be that reference. This is the measure of the de- 
crease in the SNR allowed through coding over an uncoded signal at a specific bit error 
probability. In this evaluation, a bit error probability of 10-5 will be the fixed evaluation 
level and the performance of various coding schemes measured at that point. The cor- 
responding SNR will be compared to the required SNR of the uncoded received signal 
to achieve the same rate and the corresponding coding gain will be computed. This 
coding gain will be the final performance measurement for the various coding schemes. 
This evaluation assumes that all other variables are equal, even though, in practice, this 
mav not be valid assumption. Some codes vield better results in a burst error environ- 
ment while others are tailored more toward correcting random errors. The complexity 
of various codes and their ease of implementation also varv. But these factors cannot 
be measured quantitatively and be objectively weighted in an overall performance eval- 
uation. However, the effects of each of these factors will be discussed so as to at least 


provide a subjective evaluation of each. 


A. BLOCK CODE EVALUATION 

The MFQPSK signaling system can be implemented using various packet combina- 
tions of .\f tones and .V bauds. A baseline system has been established with M = 64. 
Encoding phase information at each frequency bin will result in 128 binary bits of in- 
formation to be encoded in each baud. 

1. Hamming Codes 

The simplest method for block encoding binary data uses the (7, 4) Hamming 

code. In the case of a baud length of 128 bits, it is obvious that the bauds must be 
subdivided into what will be refered to as Hamming blocks. Each Hamming block will 
contain four bits of information and the requisite three parity bits. In order to use this 
scheme, 32 Hamming blocks are necessary to encode the required 128 information bits 
of each baud. Since each frequency bin contains a di-bit describing a phase, coding in- 


volves effectively two frequency bins per Hammuing block. 


eo 


The Hamming block method provides a very good code rate at 4/7 (.5714) but 
is limited bv its error single correcting capability. No amount of increased redundancy 
can improve this constraint. 

Another Hamming code that would be useful in the MF QPSK signaling system 
is the (15, 11) Hamming code. This has a code rate of 11/15 (.7333) but maintains the 
single error correcting capability. The (15, 11) Hamming code would be effective for 
block lengths of 16 where the additional bit can be used as a parity check thus enabling 
the (15, 11) code to detect the existence of a double error or it can be used as a timing 
or synchronization bit. As shown in Figure 9, the (15, 11) Hamming code provides a 
coding gain of 1.3 dB at a bit error probability of 10-°. 

The use of Hamming codes suggest short block lengths. This is because of the 
Hamming codes’ limit of ¢ = 1 error correcting capability. If this limit were applied to 
the entire baud, then the baud would have an error correcting capability equal to ex- 
actly the number of blocks of 16 coded bits. But the errors would have to occur at a rate 
of no more than one error per block coded bits for the Hamming code to be successful. 
For this reason, Hamming codes are not useful in environments where burst errors are 


dominant. 
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Figure 9. _—‘ Bit Error Probability for Several Block Codes 
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2. BCH Codes 


Lin and Costello [Ref. 13, Appendix C] have documented BCHI codes up to 
length 2'° — 1, showing various combinations of block lengths and information bits along 


with their respective generating polynomials. While creating an inordinately large block 
length, like (1023, 11) ¢ = 25 


255, in order to take advantage of the large error correcting 
capability, the added block length increases the transmission bandwidth and the de- 
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creases code rate (.011 in this example). This is unacceptable for the application of in- 
terest here. To combat this, it is desired to have the block length long enough to encode 
the data with a code that has an acceptable error correcting capability. In the example 
of transmitting 64 frequencies (128 information bits) two approaches may be taken. 
a. A (127, 64) BCH Code 

To maintain a baud-to-block length continuity, a (127, 64) with r = 10 
BCH code can be used. In this case, each baud that is transmitted contains 64 infor- 
mation bits as well as the 63 parity bits in order to generate a block of 127 coded bits. 
A block parity bit may be added to increase block length to 128 elements. Computer 
programs used to evaluate the performance of various schemes utilizing BCH codes (see 
Appendix A) have shown that the effect of the added parity bit is negligible. That is, the 
SNR at any bit error probability is decreased by less than .1 dB. At a bit error proba- 
bilitv of 10-5, the coding gain achieved for the (127, 64) BCH code is 2.8 dB. This result 


is shown in Figure 10. 
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Figure 10. Bit Error Probabilities for BCH Codes 


b. A (255, 139) BCH Code 
In order to include all 128 information bits of one baud in a single block, 
a (255, 139) with r= 15 BCH may be used. This will maintain baud continuity in that 
all the 128 information bits are encoded in the same block. The (255, 139) code allows 
for 139 information bits, 11 more than that contained in the individual baud. What to 


do with the extra information positions can be the subject of further research. Possibil- 
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ities include using the 11 extra information positions as synchronization data bits. In 
this manner, the signal will be synchronized every baud and eliminates the necessity of 
a synchronization tone or preamble. Perhaps cryptographic keying information may be 
contained in the 11 extra positions. Again the addition of an overall parity bit, like the 
previous (127, 64) BCH code is necessary. Figure 11 shows the information/parity bit 
relationship of the modified (255, 139) BCH code. 







128 information bits 


256 Total Bits 


Figure 11. Bit Stream for a Modified (255,139) BCH Code 


Figure 10 shows that at a bit error probability of 10-5, the coding gain of the 
(255, 139) BCH code is 3.8 dB. This is a substantial decrease in SNR at a given bit error 
probability and clearly illustrates the advantages of error correcting codes. It should 
also be added that increased redundancy does not always mean improvements in error 
performance and, hence, coding gain. Performance degrades substantially at very high 
and very low data rates. For medium code rate block codes (1/3 to 1/4), a broad range 
of coding gains occur and are subject to increased redundancy. Outside this region, re- 
dundancy does little to increase coding gains. 

BCH codes, because they are a generalized version of Hamming codes, are 
more effective as random error correcting codes and have limited use in a burst error 
environment. However, BCH codes do offer the advantage of variable block lengths and 


improved performance with low implementational complexity. 
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3. Reed-Solomon Codes 
Reed-Solomon codes offer significant error correcting capabilities. This is be- 
cause they have the largest possible code minimum distance of anv block code of the 


same length. Minimum distance equals n— +1 and the ¢f-error correcting capability 
1S: 





Because of their large error correcting capability and corresponding moderate code rates, 
these codes tend to offer great coding gains. Continuing example in which processing 
128 binary information bits is required, two particular R-S are considered. 
a. A (127, 65) R-S Code 

Using arguments similar to those used previously in the discussion of the 
(127, 64) BCH code, the (127, 65) with t = 31 R-S code can maintain the baud-to-block 
length continuity. However. an information sequence parity check bit is needed for the 
codes completion. An additional overall parity check bit will result in a block length 
of 2’ where /1is an integer. The error performance associated with this code is illustrated 
in Figure 12. Ata bit error probability of 10-*, the (127, 65) R-S code has a coding gain 
On 7-5 dB. 

b. A (255, 133) R-S Code 

The (255, 133) with t = 61 R-S code offers large error correcting capability 
and coding gains. In the application of processing 128 information bits, information bit 
continuity is maintained per block. That is, all 128 information bits are contained in one 
encoded block. But again, like its BCH counterpart, signal bandwidth 1s doubled be- 
cause the encoded block is approximately twice as long as the information bits contained 
in the baud. The extra information bits available in the block code (five in this case) and 
the addition of an overall parity check bit occur here in a manner simular to that en- 
countered for BCH codes. 

The greatest advantage of Reed-Solomon coding is the ability to correct 
errors that occur in short bursts where the bursts approximately match the symbol size, 
m, in a 27 length code. Conversely, R-S codes do not perform as well as BCH codes in 


a random error environment. 
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Figure 12. Bit Error Probabilities for Reed-Solomon Codes 


B. CONVOLUTIONAL CODE EVALUATION 

From Equation (4.60a) the variables involved in specifying the performance of a 
convolutional code are primarily influenced by the values of d,,,. This factor, in turn, is 
a parameter of the constraint length of a code, K. It is desirable, in terms of perform- 
ance levels, to use the largest value of K without unnecessarily complicating the 


encoder/decoder structure. Odenwalder investigated a code’s constraint length versus 
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coding complexity and documented the results in Ref. 16. A convolutional code of 
constraint length, K = 7, using a Viterbi decoding algorithm was found to yield the best 
overall performance characteristics. Therfore only convolutional codes with K = 7 and 
Viterbi decoding will be considered here. An additional condition that must be estab- 
lished prior to the code’s evaluation is the code rate. While evaluating possible block 
codes in the previous section, code rates very near 1/2 were considered. In order to 
preserve a consistent evaluation, convolutional codes with R = 1/2 will be evaluated. 
Code rates of less than 1/2 will provide better decoded bit error rate performance but this 
improved performance will come at the cost of bandwidth and receiver complexity. 
With the above conditions (K = 7, R = 1/2), convolutional codes can be considered 
for which the free distance, d,,, is a fixed value of 10. At d,,. = 10, Ela 36. (These 
values are tabulated for various values of d,,. on page 625 of Reference 15.) A computer 
program (see Appendix B) was used to evaluate various convolutional codes based on 
combinations of d,,,, and Baa . The results are illustrated in Figure 13. The coding gain 
achieved can be measured from Figure 13 as 3.2 dB for d 


10. Iitereasing d,.. to 12 


generates a B, of 211 and a coding gain of 3.9 dB. The free distance can be increased 


ree 


as the Hamming distance between two codewords is increased. However, this will result 
in a different value for B,, as tabulated in Reference 15. 

To complete the examples presented Figure 13, a K = 5, R = 1/2 convolutional 
code is included. In ts case, d,,, = 7 and B, =4. This example is included because 
a K=5,R=1/2 code is available in a single integrated circuit and would be simple to 
implement. Using the convolutional code incorporated in this integrated circuit, a cod- 
ing gain of 2.5 dB will be achieved. 

Convolutional codes in general respond very well in a burst error environment. 
Specific classes of convolutional codes have been developed to further improve the burst 
errors correcting capabilities. The Berlekamp-Preparata code and the Iwadare- Massey 


code are two of these codes and are discussed on pages 430 - 440 of Reference 14. 
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Figure 13. Bit Error Probabilities for Various Convolutional Codes 
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VI. CONCLUSIONS 
A. THE MFQPSK SIGNALING SYSTEM 


This study has presented the fundamental principles of a multi-frequency modu- 
lation (MFM) scheme. The major factor for considering this scheme is the potential use 
of this modulation technique in a variety of media. More specificallv, the MFM scheme 
was directed towards a Multiple Frequency Quaternary Phase Shift Keyed (MFQPSK) 
signaling system in an underwater acoustic signaling application. The MFQPSK sig- 
naling system was first presented, and then followed by the establishment that error 
detection ‘correction (EDC) is a desireable feature for insuring fidelity of the received 
signal. However with the many EDC coding schemes available, a determination of those 
best suited for the signaling system under consideration had to be made. Decoded bit 
error rate performance using various block and convolutional codes were evaluated and 
a computer program generated to calculate and plot these bit error probabilities as a 
function of SNR. After considering specific coding schemes (such as Hamming, Golay, 
BCH, R-S, and convolutional codes), a deternmunation was made as to how each of the 
selected coding schemes could be used in conjunction with the MFQPSK signaling sys- 
Gen). 

The performance of each of the many block codes and convolutional codes vary 
when subjected to different channel environments. In an environment in Which random 
errors most often occur, Hamming, Golav, and BCH codes outperform R-S and 
convolutional codes as a whole. This is a broad generalization, but one which can be 
substantiated by evaluating error performance associated with each of the codes. It 1s 
evident that if the channel environment can be successfully predicted (determination of 
burst versus random error conditions), then the EDC coding selection would be simph- 
fied. However. the channel environment cannot be accurately predicted. Furthermore, 
the channel medium must be characterized and modeled accurately. Flowever the degree 
of complexity of this effort is such that a separate project 1s being carried out, concur- 
rently with this study, that involves modeling an underwater acoustic channel as the 
medium for propogation of the MFQPSK signal. Until such time as experimental results 
can verify the channel model being developed, all results are subject to the validity of the 


assumptions in the model. 
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When using block codes for EDC in the MFQPSK svstem, selection of baud length 
to be transmitted will affect the selection of a block code to be used. Hamming codes 
provide adequate coding gains when used as a short block code in a random error envi- 
ronment, but are limited by their error correcting capability. BCH codes vield good 
coding gains at the specified value of bit error probability used in this project. BCH 
codes offer a wide selection of block lengths and error correcting capabilities, with good 
responcs when used in environments where random errors dominate. R-S codes provide 
substantial coding gains, however at a price that R-S codes being g-ary codes, block 
lengths are large (a R-S code where g = 2 1s the same as a binary BCH code). These 
large block lengths add complexity to the encoder and decoder structures. 

A class of codes that perform well in environments where either type of error, ran- 
dom or burst, occur are the group of convolutional codes. Since convolutional code’s 
performance is dependent on the number of stages in the shift register used to generate 
the code, their implementation tends to be less complex than that of block codes. The 
number of stages in the shift register, called the constraint length, affects two parame- 
ters, namelv (@,,, and Bz...) which are used in the evaluation of bit error rate performance 
of convolutionally encoded data. Once a constraint length is established, these two pa- 
rameters can be determined and performance evaluated. An advantage of applying 
convolutional codes to the MFQPSK signal system 1s the inherent ability to process the 
bit stream continuously. As bauds become filled with information (binary data), they 
can be processed through the convolutional encoder while other bauds are filled with 
more information. 

In conclusion, convolutional codes were found to provide adequate values of bit 
error probabilities over a wide range of SNR’s and significant coding gains. Addi- 
tionally, they are relatively easy to implement and are well suited to the MFQPSK sig- 


naling system and its signal structure. 


B. AREAS OF CONTINUED RESEARCH 

The EDC codes studied in this project were developed singularly. Coding schemes 
used in existing communication systems use a combination of these individual codes. 
Such codes are referred to as concatenated or interleaved codes. Concatenation is a 
method of constructing long codes from shorter codes. Concatenated coding can be 
explained by the following: encode an information bit stream initially using a R-S code 
and then process the resulting encoded bit stream through a convolutional encoder. This 


double coding results in concatenation. Coding gains provided by concatenated codes 


and their application to the MFQPSK signaling system present research areas which 
have as yet not been addressed. Additionally, as channel models are further refined, 
various EDC coding schemes that incorporate these channel models can be further re- 


fined, analyzed, and verified by experimental results. 
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APPENDIX A. BCH AND R-S CODING PERFORMANCE EVALUATION 


The purpose of this computer program 1s to evaluate and plot BCH and R-S coding 
performance curves on the IBM mainframe computer at the Naval Postgraduate School 
with calls to the IMSL10 library. The output graph will be a semi-logarithmic scale of 
Bit Error Probability vs. SNR. The input data will consist of the code’s description. 
For example, if a (127, 64) : = 10 BCH code were to be evaluated, the inputs would be 
K = 64.0,” = 127, andt= 10. It 1s imperative that the values are used as described in the 
initial declarations. Specifically, m and ¢ must be integers. This permits successful calls 
to subroutines and functions external to this program. The equations this program is 
designed to calculate are given by Equations (4.30) and (4.31) for BCH codes, and by 
Equation (4.52) for R-S codes. 

Flexibility is built into this program so that R-S codes may also be computed using 
this program. Program lines which need modification depending on which code 1s being 


coniputed are noted with an asterisk (*). 


C 
C 
C 
C VARIABLE DECLARATIONS 
C 
REAL. BC, dd, Tl. NNeeeZee oe 
REAL RK; SNR, APLEC 2000) 5 ye 2000 esas ly Oem 
DOUBEE PRE CISiGIN x yareeeee ee 
DOUBLES PRECISION PROE thar ene 
INTEGER Tie Te Neal 
C 
C 
C VARIABLE INPUTS 
C 
K = 64.0 
N = 127 
T = 10 
Cee ee ie a7 
C This is needed to generate the scaling factor for R-S codes and 
C is different for each code. M=7 is an example only. 
C 
C INITIALIZATION 
C 
II = 0 
R = K/N 
I= T +a 
TP1 = J 
TWO = 2 
S = SQRT( TWO) 
€ © SF = (2 ** (M - Dr eZ dede M) -1) 


46 


G2) CQ C2 Grea OG 


IOI Gita 


Cacao) 


80 


This is the scaling factor for R-S codes. 


PROGRAM COMPUTATION. This starts the loop. For each value 
of Z, a Q(.) is calculated and later used in computing 
probability. The DERFC is a double precision intrinsic 
function describing the co-error function as defined in 
Bauation (3.2). The BINOM is another intrinsic function 
which computes the binomial coefficient of N and J for 

each iteration of J. R represents the code rate, K/N. 


DO 100, Z=1, 40, 1 
RS GORGI 2 ayemes i> 
Q = .5 * DERFC(X/S) 
SNR = 10 * ALOG10(2Z) 


PROB = 0.0 
DO 80, J = TP1, N 
BC = BINOM(N,J) 
NN = N 
Her = J 
a= T 
P1 = ((JJ + TT)/NN) 
P2 = ((1 - Q) ** NN) 


PPMip = Pies pole a 
Mer 2 = (0/Ci= ae eC Jd) 100.0) 
DO 205 N= 2 100 
Tiina. GEo1E-75) THEN 


This IF statement was necessary to prevent 
underflow problems on the IBM mainframe. 

Any value less than 1E-75 was considered 

equal to zero. While this is recognized as 
undesirable, it was necessary to continue with 
the program. 


SEMeis— TENE TEMP 2 
ELSE 
TEMP1i = 0.0 
BNDTE 
CONTINUE 
BC. Wak 
PROB = PROB + TEMP] 
BESE, R-5 
RS = SF * PROB 


WRITE (81,200) SNR, PROB 


CONTINUE 
II =II +1 
MPLIC IL) = "SNR 
YPLT(II) = PROB 


100 CONTINUE 
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C2) €2Co Clee Coe) 


200 FORMAT( 2X, (b724)) 2A 


PLOTTING. This plotting routine is unique to the DISSPLA graphics 


program, version 9.0. 


Explanations and applications are best 


addressed by the reference manual and will not be individually 


considered. 

CALL COMPRS 

CALL PAGE( 11,8. 5) 

CALL NOBRDR 

CALL AREA2D(6,8) 

CALL XNAME(' SNR $’ ,100) 


CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 


STOP 
END 


YNAME(* BIT ERROR PROBABILITY $* , 100) 
HEADIN(' BCH CODED PROBABILITY $ ,100,4,1) 
GRACE(0. 0) 

YLOG(4.0,1.5,0. 0000000001, 1. 0) 

SETCLR( ‘MAGENTA’ ) 

CURVE(XPLT, YPLT,10,0) 

ENDGR( 1) 

ENDPL( 1) 

DONEPL 
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APPENDIX B. CONVOLUTIONAL CODING PERFORMANCE 
EVALUATION 


The purpose of this algorithm is to compute and plot convolutional coding per- 
formance curves. Equation (4.60a) defines the equation used in this program. As in 
Appendix A, the semi-logarithmic axes will be Bit Error Probabilitv and SNR. 

Variables are defined as follows: 


BDF= Bg, 
and 
DF =p, ¢¢ 
and K= constraint length of the code. 
C 
C 
C VARIABLE DECLARATIONS 
C 
Peeteoues BDF, Ks Ss, SNR, XPLT(500), YPLI(500), T,72 
DOUBLE PRECISION X, Q, PROB 
INTEGER II 
C 
C 
C VARIABLE INPUTS 
C 
DF = 7.0 
BDF = 4.0 
K = 7.0 
C 
C 
C INITIALIZATION 
C 
D2 = DF/2 
T = 2.0 
S = SQRT(T) 
II = 0 
C 
C 
CG PROGRAM COMPUTATION. For each value of Z, a Q(.) is determined. 
C DERFC is a double precision intrinsic function describing the 
C co-error function as defined in Equation (3.2). 
C 


pO 100, Z=1, 20, 1 
X = SQRT(Z) 
Q = .5 * DERFC(X/S) 
SNR = 10 * ALOG10(Z) 
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C) G2 QQ & o) 


Fe 


= (1/K) * BDF * (2 ** DF) * (Q ** D2) 


WRITE (9, 200) SNR, PROB 
tS ee 
XPLTCII) = SNR 


YELL GES) 


PROB 


100 CONTINUE 


200 FORMAT (2X, F7.4, 2X, D12.7,/) 


PLOTTING. This plotting routine is unique to the DISSPLA graphics 
program, version 9.0. Explanations and applications are best 
addressed by the reference manual and will not be individually 
considered. 


CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 
CALL 


STOP 
END 


COMPRS 
PAGE(11,8.5) 

NOBRDR 

AREA2D( 6,8) 

XNAME( 'SNR $',100) 

YNAME( ‘PROBABILITY $',100) 

HEADIN( 'CONVOLUTIONAL CODE PERFORMANCE $',100,4,1) 
GRACE(0. 0) 

YLOG(3. 0,1.5,0. 000000001, 1. 0) 

SETCLR( 'MAGENTA' ) 

CURVE(XPLT, YPLT, 20,0) 

ENDGR(1) 

ENDPL(1) 

DONEPL 
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